We present spectra taken with the Low Resolution Imaging Spectrograph on the Keck 10m telescope of spatially-resolved structures ("fuzz") around the high-redshift radio-loud quasars PKS 0445+097 (z=2.108) and PKS 2338+042 (z=2.589). For PKS 0445+097 we find that there is faint extended HeII1640 and CIII]1909 from the quasar host galaxy. Both of the lines are broad (FWHM(HeII)=1000+-200 km/s and FWHM=2200+-600 km/s). The limits on the fluxes, the large line widths, and the line ratio HeII/CIII] are similar to that observed for high redshift radio galaxies. From the spectrum of PKS 2338+042, we find extended Ly-alpha emission on scales about 10'' which is strongly one sided (on the side of the stronger, closer to the nucleus, more distorted radio lobe). The extended Ly-alpha line is broad with widths of over 1000 km/s. We also find weak extended CIV and HeII emission which has similar characteristics (line widths, line fluxes, and line ratios) to that of high redshift radio galaxies. In addition, we serendipitously discovered what appears to be a Ly-alpha emitting galaxy about 29'' to the southeast of the quasar at z=2.665.